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ABSTRACT 


Disclosed are a method and system for directly manipu- 
lating an icon in a data processing system. The method 
includes attaching a visual pointer to the icon and mov- 
ing the pointer with the icon attached thereto about the 
display screen. While the pointer remains attached to 
the icon, the user can manipulate other software ob- 
jects. 

12 Claims, 6 Drawing Sheets 
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ment of items on the display screen, the user must place 
METHOD AND SYSTEM FOR PERFORMING the source object at some convenient location on the 
DIRECT MANIPULATION OPERATIONS IN A screen and then surface the target object or location. 

COMPUTER SYSTEM After the user has surfaced the target object or location, 

5 assuming that the source object has not become ob- 
BACKGROUND OF THE INVENTION scuredt ^ ^ ^ drag and drop the source on the 

1. Field of the Invention target. 

The present invention relates generally to graphical In co-pending application Ser. No. 07/703,434, filed 

user interfaces in computer systems, and, more particu- May 17, 1991, which is assigned to the assignee of the 

larly, to a method and system for performing direct 10 present application, a method is provided for facilitating 

manipulation operations in a graphical user interface. direct manipulation of selectable visual icons in a data 

2. Description of the Prior Art processing system having a plurality of viewports or 
Presently existing graphical user interfaces typically windows that at least partially overlap each other and 

include a plurality of selectable visual icons that repre- obscure certain of the selectable visual icons. When the 
sent software objects, including documents and files, as 15 user begins to drag one of the icons, the system moni- 
well as software applications, such as text editors and tors ^ position of the dragged icon on the display 
spreadsheets, and operations such as printing, deleting, scre en. Whenever the dragged icon moves into another 
or filing. As a practical matter, nearly any software wi^ow 0 r viewport, the system automatically rear- 
document or operation can be visually represented by a ^ railges ±e order in which ±e viewports or windows 
selectable visual icon. overlap so that the window or viewport that currently 
One of the great promises of graphical user interfaces cQntams ^ d ^ icon . Qn of ^ ^ Jhe 
lies u .their intuitive nature. Users can draw cm their real solution solves some, but not all, of the prob- 
world experiences in performing various tasks in the le J^ ated with ±t « one .^nded" direct manipula- 
electromc workplace created by the graphical user «"«^««^ "« f , lu<u 
interface. For example, in character basVuser inter- 25 Uon. For example, the foregoing solution assumes tha 
faces, if the user wishes to print a document, the user * e W loc f^ on 15 » a window that is open^ but not 
mustlmowand.beabletotypeanappropriatecornmand Presently visible on the screen. However, the target 
or series of commands- In contrast, with a graphical location mav be ™ a window that has not yet been 
user interface, the user can, with a mouse or other point- opened, or may be m a portion of a wmdow that is not 
ing device, drag an icon that represents the document 30 visible even when the window is surfaced, i.e., the user 
the user wishes to print across the computer display may need to scroll the window to reach the target loca- 
screen and drop the document icon on another icon that tion. The foregoing solution does not provide a means 
represents a printer. Similarly, if the user wishes to file by which the user can open new windows or scroll data 
the electronic document in a particular file, the user within open windows while dragging a source object. 

^^^^Z^^^^ 60 "^ 35 SUMMARY OF THE INVENTION 

and drop it on the appropriate rile icon. 

A drawback to presently existing direct manipulation The present invention provides a new technique by 
techniques is the requirement that both the source icon which users may interact with a'^pKc^user interface )> 
and the target location or icon must be simultaneously while they are performing a direct manipulation opera- 
visible. As a practical matter, the source and target 40 tion. In the preferred embodiment of the invention, the 
objects are rarely visible at the same time. Therefore, in system includes a two-butt on mouse. M ouse button 
a substantial number of cases, the user must painstak- number one is used for selection operationsjand mouse 
ingly rearrange the items on the display screen to simul- button number two is used foTdirec^tlnampulation oper- 
taneously expose both the source and target objects ations . In ±e present invention, the user can pick up an 
prior to initiating the direct manipulation operation. 45 object for direct maiupulation by chcking mouse button 
The necessary rearrangement is made even more diffi- num ber two while the pointer, the position of which is 
cult because in currently existing implementations, it is controUe d by the mouse, points to the object Afterthe 
as if the user is able only to use one hand. For example, 0 bjecTh^tee1Tr^k^~up by choking mouse buttoni 
m the real world, the simple tesk of moving a document number ^it W^^ 

from one folder to another in a fOe drawer would be 50 ^ 0 f.the-mouse r even though mouse button number ' 

o^dT^ twoisnotpres^ 

Staining the document and then^ove the docu- ation, the fject is v*uaUy attached to the poin er. TTie 

ment. However, since the user can use only one hand, object will remain attached to the pointer until mouse 

the user would have to set the document down some- 55 &*nua^ 

where convenient, such as his desktop, in order to free ?^^^^S^S^^P^ ht p0mter and dro PP ed on 7 

his hand to open the other folder. Next the user would P* e G^P^y screen, r— 

have to go back to the desktop, pick up the document v ^Wmle the pointer is attached to the object, the user 

again and place it in the second folder. A clever person . can perform operati ons usin g mouse button number 

with a relatively empty file drawer might be able to 60 one - For example, the user may open folders, surface J 

open the second folder and then carefully open the first windows, turn pagesrScroU data in windows, and per- 

folder without affecting the second folder. In this case, form other operations while the object being directly 

the person could, with one hand, pick up the document manipulated remains at tached to^the pointer. JIftus,Jjn 

from the first folder and transfer it to the second folder ef fect, th e user can carry the directly ^mani^ula|ed 

all in one motion. However, this approach requires 65 source oSject v dir^y^tfc^ 

more steps and is awkward and not intuitive, the same way that zr person in the real world can carry 
Similarly, in presently existing graphical user inter- an object in one hand while opening drawers and rear- 
faces, unless the user is very fortunate in the arrange- ranging items on a desk with the other hand. 
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' ^ ^„ a ,„ IVI ^ 0 embodiment of the present invention, mouse 21 includes 

BRIEF DESCRIPTION OF THE DRAWINGS at least two Mrimg mouse button number 

FIG. 1 is a depiction of a data processing system that one which is designated by the numeral 23 and mouse 
may be used to implement the method and system of the button number two which is designated by the numeral 
present invention. 5 25. 

FIG. 2 is a pictorial representation of a computer Referring now to FIG. 2, a window 27 is displayed 
display screen with a workplace window displayed on display screen 18. Window 27 includes a title bar 29, 
thereon. an action bar 31, and a client area 33, all of which are 

FIG. 3 is a pictorial view, similar to FIG. 2, with a enclosed in a border 35. Title bar 29 includes, in addi- 
folder window superimposed on the workplace win- 10 tion to a label 37 that identifies window 27 as the 
dow and illustrating a sequence of operations of the "Workplace-Daily" window, a system menu icon 39, 
present invention. and sizing icons 41 and 43. System menu icon 39 allows 

FIG. 4 is a pictorial view similar to FIGS. 2 and 3, the user to display a pull-down menu that contains the 
with the workplace window superimposed upon the actions that the user can perform on a window, such as 
folder window and showing additional steps of the 15 restoring, moving, or sizing the window. Window siz- 
sequence of the method of the present invention. ing icon 41 provides a fast way to use the mouse and 

FIG. 5 is a pictorial view of another representation of pointer 19 to minimize or reduce window 27 to an icon 
the folder window superimposed on the workplace without opening the pull-down menu from system 
window in a computer display screen. menu icon 39. Similarly, sizing icon 43 allows the user. 

FIG. 6 is a pictorial view similar to FIG. 5 in which 20 to maximize window 27 to the full extent of screen 18. 
the workplace window is superimposed on the folder Action bar 31 contains a listing of the actions of the 
window showing a sequence of steps of the present application of window 27. For example, the user, by 
invention. selecting the File action of action bar 31, can display a 

FIG. 7 is a pictorial view similar to FIG. 6 showing pull-down menu that includes such actions as OPEN, 
further steps of the sequence of the present invention. 25 SAVE or EXIT. 

FIG. 8 is a flowchart of the initialization routine of Client area 33 of window 27 is populated with a plu- 
the method of the present invention. rality of icons, including a Project X icon 45, a Shred- 

FIG. 9 is a flowchart of the LOAD AND RUN der icon 47, and a Printer icon 49. Project X folder icon 
DIRECT MANIPULATION PROGRAM routine of 45 represents a container that contains various docu- 
FIG. 8. 30 ments. Project X folder icon 45 can be opened to dis- 

FIG. 10 is a flowchart of the PROCESS POINTER play a Folder-Project X window 51, which is shown in 
input routine of FIG. 8. FIG. 3, by either pointing to Project X folder icon 45 

FIG. 11 is a flowchart of the PROCESS MOUSE with pointer 19 and "double clicking" mouse button 
MOVEMENT routine of FIG. 10. number one or by selecting icon 45 and then selecting 

FIG. 12 is a flowchart of the REDISPLAY pointer 35 the open action from the File action's pull-down menu 
routine of FIG. 11. of action bar 31. 

FIG. 13 is a flowchart of the PROCESS BUTTON 1 Shredd^c^4J7 and Printer icon 49 are device ob^ 
NUMBER ONE INPUT routine of FIG. 10. jecfeic^fe^nridder ^icon j^7 representilan_application 

FIG. 14 is a flowchart of the PROCESS BUTTON that dele tes ob jects. Similarly, Printer icon 49 repre-7 
NUMBER TWO INPUT routine of FIG. 10. 40 senlsTprint application. Thus, a user can,'for~example, 

ilrag Project X folder icon 45 to Shredder icon 47 and 
thereby delete the Project X object and its contents. 
Referring now to FIG. 3, Folder-Project X window, 
Referring now to the drawings, and first to FIG. 1, which it will be recalled was opened from Project X 
there is shown a pictorial representation of a data pro- 45 folder icon 45, contains a plurality of object icons in- 
cessing system 10 that may be utilized to implement the eluding Document 1 icon 53. Document 1 icon 53 rep- 
method and apparatus of the present invention. Data resents a document Document 1 icon 53 can be opened 
processing system 10 includes a processor 12 (with an in the same way that window 51 was open_ed, _thereb y to 
internal central processing unit, read only memory, and display the contents of Document 1. Similarly, Docu- 
random access memory, which are not shown but well 50 jrnOTt l can be printe^ th^ 

known to those skilled in the art) which is coupled to a dragging it to and droppin^Ttvu^n^rmter . icon 49. } 
keyboard 14 and a display device 16 in a manner well Also, document l ean be deleted through direct manip- 
known in the art. Processor 12 is adapted to receive ulation by dragging it to and dropping it upon Shredder 
removable storage media such as diskette 13 to receive icon 47. However, in FIG. 3, the portion of window 27 
application and other software as well as data. Those 55 that contains Shredder icon 47 is obscured by window 
skilled in the art will recognize that data processing 51, and, therefore, a user cannot simply drag Document 
system 10 may be implemented by using any suitable 1 icon 53 directly to Shredder icon 47. 
computer, including a personal computer or a worksta- In the prior art, direct manipulation was performed 
tion coupled to a host computer. One example of a data by positioning pointer 19 on the source object, for ex- 
processing system that may be used to implement the 60 ample, Document 1 icon 53, and pressing, as opposed to 
method and apparatus of the present invention is the clicking, mouse button number two. Then, without 
IBM PS/2 personal computer. releasing mouse button number two, the user could 

Referring still to FIG. 1, display screen "18 has dis- move the mouse and thereby move pointer 19 and 
played thereon a pointer 19 that is used in a manner well . source object icon 53. When pointer 19 and source 
known in the art to indicate a selected position upon 65 object 53 reached the intended target ob ject, for exam - 
computer display screen 18. Pointer 19 may be moved pie Printer icon 49, tfieusercould release mouse button 
about , on computer display screen 18 by moving a iminj^ two, and thereby^ 

mouse 21, as is well known in the art In the preferred targg^ object icon 4 9; whereupon the system wouldl in 
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the illustrated example, print Document Din the prior 
art, if the user wanted to delete Document 1 by direct 
manipulation, the user would have to rearrange screen 
18 such that Document One icon 53 and Shredder icon 
47 were visible simultaneously. The user could do this 
in several ways. For example, the user might be able to 
move window 51 sideways until Shredder icon 47 be- 
came visible. Alternatively, the user could move Docu- 
ment 1 icon 53 from window 51 to, for example, win- 
dow 27, and then surface window 27, either by clicking 
mouse button number one on it, or minimizing window 
51. Then, the user could drag Document icon 53 to and 
drop it Upon Shredder icon 47. The action of moving 
Document 1 icon 53 from window 51 to window 27 
takes a substantial amount of time because the location 
of Document 1 has to be changed in system memory. 

In application Ser. No. 07/703,434, filed May 17, 
1991, there are disclosed a system and method that 
overcome some of the shortcomings of the prior art In 
the system and method of application Ser. No. 
07/703,434, whenever the user directly manipulates an 
object, the system automatically surfaces whichever 
window the user happ ens to be over . Thus, in the exam - 
ple o f FIGS. 2-4, jf the user were tcudrag Document 1 J 
ftcon 53 out of window 51 into window 27, window 27 23 
Would automatically be surfaced. *AccordingIyr-the J 
method and systenTof application Ser. No. 07/703,434 
provide some advantages over prior art However, 
when several windows are simultaneously opened on 


10 


15 


20 


Daily window designated by the numeral 27a. Window 
27a represents the same workplace as that represented 
by window 27 of FIGS. 2-4 and it contains the same 
objects as those displayed in window 27 of FIGS. 2-4. 
However, as is best illustrated in FIGS. 6 and 7, the 
viewport formed by a window 27a is narrower than the 
viewport of window 27 and not all of the object icons in 
the workplace are visible simultaneously in window 
27a. Thus, window 27a includes a scrollbar 55, which 
indicates that there are items in the workplace that are 
positioned outside the viewport. Scrollbar 55 includes a 
left arrow 57 and a right arrow 59. As is well know to 
those skilled in the art, the user can scroll the data in the 
viewport of window 27a by means of arrows 57 and 59. 
A slider box 61 indicates the relationship of the view- 
port to the objects in the workplace. Thus, in FIG. 6, 
the viewport of window 27a is positioned at the left- 
most end of the objects and in FIG. 7, it is positioned at 
the rightmost view of the objects. 

Referring particularly to FIG. 5, Folder-Project X 
window 51 is shown superimposed upon Workplace- 
Daily window 27a. In the example of FIGS. 5-7, the 
user wishes to print Document 1 by direct manipula- 
tion. According to the present invention, the user posi- 
tions pointer 19 on Document 1 icon 53 and clicks 
mouse button number two, whereupon Document 1 
icon 53 becomes attached to pointer 19. The user may 
then move pointer 19 with Document 1 icon 53 at- 
tached thereto out of window 51 and into window 27a, 


the screen, it can be distracting to the user and use 30 as shown in phantom in FIG. 5. The user, knowing that 


substantial system time in repainting the screen as vari- 
ous unwanted windows pop to the surface. Also, the 
method and system of Ser. No. 07/703,434 are some- 
what limited in that they allow the user only to surface 
windows that are already open and not to open closed 
windows or reposition windows, or scroll windows, or 
perform other operations that might be necessary or 
desirable. 

In the method and system of the present invention, an 


the printer icon is located in the workplace window, 
can surface window 27a by clicking mouse button num- 
ber one, thereby to arrive at the configuration shown in 
FIG. 6. However, since window 27a does not show the 
35 entire workplace within its viewport, the printer icon is 
not visible in the view of FIG. 6. According to the 
invention, the user may then, as illustrated in phantom 
in FIG. 6, move pointer 19 with Document 1 icon 53 
attached thereto to the right arrow box 59 of scrollbar 


additional direct manipulation mechanism is provided. 40 55 and, by clicking mouse button number one, scroll 


Referring to FIG. 3, direct manipulation of Document 1 
icon 53 is initiated by pointing to Document 1 icon 53 
with pointer 19 and clicking mouse button numbertwo, 
which is d esignated by thenumeraT25 in FIG. l./When/ 
t% user clicks~mouse button number. tjvcvon Document) 45 

ammmmXMmMm^mam so attached until'/ 


5 


['*p88bnn 

any dTtne hbl^iWduseoperatibhls. 'As shown in phan- 
tom mHG. 3, the user can move pointer 19, with Doc- 
ument 1 icon 53 attached thereto, out of window 51 and 
into window 27. However, repositioning pointer 19 and 
Document 1 icon 53 into window 27 does not result in 
the automatic surfacing of window 27. However, if the 
user does desire to surface window 27, the user may do 
so by clicking mouse button number one, whereupon 
window 27 will be surfaced, as shown in FIG. 4. The 
user may then drag Document 1 icon 53 with pointer 19 
attached thereto to Shredder icon 47. If the user desires 
to delete Document 1, the user may do so by clicking 
mouse button number two, and thereby detaching 
pointer 19 and dropping Document 1 icon 53 on Shred- 
der icon 47. 

Referring now to FIGS. 5-7, there is shown another 
example of the system and method of the present inven- 
tion. In FIG. 5, there is shown a view of the Workplace- 


55 


60 


65 


client area 33 of window 27a until printer icon 49 be- 
comes visible, as shown in FIG. 7. Then, the user can 
move pointer 19 with Document 1 icon 53 attached 
thereto to printer icon 49 and, by clicking mouse button 
number two, cause the system to print Document 1. 

It will be recognized that the present invention also 
supports "normal" direct manipulation, in which mouse 
button number two is held down until the source object 
is dropped. An additional benefit of the present inven- 
tion, however, is that it avoids the problem of current 
techniques when users have to pick the mouse off of the 
work surface while still pressing down mouse button 
number two. For example, users sometimes, in effect, 
run out of room in which to physically move the mouse 
while they are moving the pointer on the display screen. 
When a user does so, the user simply picks up the mouse 
and repositions it on the work surface so that the user 
can continue moving the pointer. During direct manip- 
ulation, it takes no small amount of manual dexterity to 
pick up the mouse while continuing to press mouse 
button number two in the opposite direction: In the 
present invention, by clicking mouse button number 
two to attach the pointer to the source object, the user 
can pick up the mouse without dropping the source 
object. It should be recognized that a direct manipula- 
tion operation according to the present invention may 
be cancelled at any time by dropping the source object 
on an invalid target or upon a target that would result in 
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no operation or by pressing the cancel key (not shown) dragged object attached to it and returns to block 71 of 

on the keyboard. FIG- 8 to continue monitoring user input. 

Referring now to FIG. 8, there is shown a flowchart Referring again to FIG. 10, if at decision block 83, the 

of a preferred software implementation of the initializa- pointer input is a button number one input, then the 

tion routine of the present invention. First, at block 61, 5 system executes the process button number one input 

the system loads and runs a graphical operating system, routine designated generally by the numeral 85 and 

such as the IBM OS/2 Presentation Manager operating illustrated in detail in FIG. 13. Referring to FIG. 13 

system. Then, the system loads and runs a program or button number one is the normal selection button on a 

programs that support direct manipulation, which is twc > button mouse and button number one inputs are 

generally indicated at block 63. Referring to FIG. 9, 10 processed in a manner well known to those skilled in the 

there is shown details of a preferred load and run direct FIG. 13 thus illustrates examples of various mouse 

manipulation program according to the present inven- button-number one interactions. At decision block 101, 

tion. First, at block 65, drag2 and drag are set equal to ^ system tests whether or not the button number one 

false. Drag is the "normal" direct manipulation tech- ^P* » button down - If {t ^ svstem tests at decision 

nique in which mouse button number two is pressed 15 block 103 whether or not the pointer is over a covered 

while the pointer is moved about the screen. Drag2 is window ™ d > if ix * e system brin^ the covered win. 

the direct manipulation technique in which mouse but- *™ front of stack of wmdows at block 105. 

ton number two is clicked. After drag2 and drag have V 1 ™ the system retums 10 b ° ck 71 u of ^ * 

been set equal to false, the system loads the program at to J* ^itonng user input If, on the other hand, the 

block 67 and runs the program at block 69. Samples of 20 P«» * not 0V «J f «™»? ^t?\*\^?*? l<Kk 

programs that support direct manipulaa^ciude «*• * e ^tern tests at decision block 107 whether or 

those illustrated in FIGS. 2-7. After the direct manipu- not ***^ * ° f VCr 3 "T^Ti? th ^ omt % 15 ovc ' 

lation program has been loaded and started to run, the a ^ roUb ^ * e ^ em > at * look 109 P erforms * e 

* S + ttts* o + * * * wi i action and returns to continue monitoring user input If 

system remrns to HO. .8 to monitor user input at block l% P 

71. If, at decision block 73, the user input is a pointing don \ lock m nor over a at dedsion block 

device input, then the system processes pomter mput as ^ ^ ^ ^ ^ blQck n 

indicated generally at block 75 If, at decision block 73, Qf M ^ ^ fe Qver ^ other object Jf 

the user input is something other than pointing device ^ intef fe Qver some other objectj the s tem 

input, as for example, keyboard mput, the system pro- 3Q fofms the a ^ action for a button number one 

cesses the other inputs at block 77 and returns to con- click Qn ^ Qbject at bJock n3 Again> buttQn number 

tinue monitoring user input one input can be any of the weD known input such as 

Refernng now to FIG. 10, there are shown details of moving a wind0Wf maximizing a window, or minimiz- 

a preferred implementation of the process pointer input ing a After the button down input has been 

routine of the present invention. The system tests at 35 processed the system returns to block 71 of FIG. 8 to 

decision block 79 whether or not the pointer input is con tinue monitoring user input 
mouse movement If it is, the system executes the pro- Referring again to FIG. 13, if the button number one 

cess mouse movement routine indicated generally at - m?ot ^ not button down at decision block 101, the 

block 81. If, at decision block 79, the pointer input is not system tesXs at decision block 115 whether the button 

mouse movement, the system tests at decision block 83 40 numbe r one input is button up. If it is, and the action is 

whether or not the pointer input is a mouse button a selection, the system completes the selection at block 

number one input; if it is, the system executes the pro- 117 returns to block 71 of FIG. 8 to continue moni- 

cess button number one input routine indicated gener- toring user input 

ally at block 85. If the pointer input is not mouse button Referring again to FIG. 10, if at decision block 87, the 

number one input, then the system tests at decision 45 pom ter input is a button number two input, then the 

block 87 whether or not the pointer input is a mouse system processes the button number two input generally 

button number two input, and if it is, the system exe- at block 89, the details of which are shown in FIG. 14. 

cutes the process button number two input routine indi- Referring specifically to FIG. 14, the system tests at 

cated generally at block 89. decision block 119 whether or not the button number 

Referring now to FIG. 11, there are shown details of 50 two input is button down. If it is, then the system tests 

an implementation of the process mouse movement a t decision block 121 whether or not drag2 is true. If 

routine of the present invention. First, "moved" is set drag2 is true, then the system executes the redisplay 

equal to true at block 91. Then the system executes the pointer routine indicated generally by the numeral 93 

redisplay pointer subroutine indicated generally at and shown m detail in FIG. 12. It will be recalled that 

block 93. Referring to FIG. 12, there is shown a pre- 55 in FIG. 12 that if drag2 is true, then the pointer is redis- 

f erred implementation of the redisplay pointer routine played with the dragged object attached at block 99. 

of the present invention. First the system tests at deci- However, it will also be recalled that when the system 

sion block 95 whether or not either drag and moved is is initialized at FIGS. 8 and 9, drag2 and drag are set 

true or drag2 is true. It will be recalled that in the initial- equal to false. Thus, initially, the test of decision block 

ization routine of FIG. 9, drag2 and drag are initially set 60 121 fails, and the system tests at decision block 123 

equal to false. Therefore, initially, the test of decision whether or not the pointer is over an object If it is not, 

block 95 fails and the system, at block 97, displays the the system executes the redisplay pointer routine of 

normal pointer, which is simply a pointer with no icon block 93 and returns. However, if, at decision block 123, 

attached to it, and returns to block 71 of FIG. 8 to the pointer is over an object, then drag is set to true and 

continue monitoring user input. If, however, as will be 65 moved is set to false at block 125. Then, the system 

discussed in detail hereinafter, drag has been set to true again executes the redisplay pointer routine of FIG. 12. 

and moved is true or drag2 has been set to true, the Referring again to FIG. 12, the system tests at decision 

system, at block 99 displays the pointer with the block 95 whether or not either drag and moved is true 
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or drag2 is true. Since drag has been set to true but 95 of FIG. 12, drag and moved are now both true so the 

moved has been set to false and drag2 is false, the sys- system displays the pointer with the dragged object 

tern displays the normal pointer at block 97. What this attached at block 99. 

means is that the system does not attach the pointer to When the user reaches the target location, the user 

the dragged object on a normal button two down drag 5 releases button number two, which results in a "yes" at 

unless there is also movement Referring to FIG. 11, if decision block 127 of FIG. 14. The system tests, at 

there is mouse movement, then moved is set to true at decision block 129, whether or not moved is true. Since 

block 91 and then the system executes the redisplay it has been set to true by virtue of the mouse movement, 

pointer routine of block 93. Referring again to FIG. 12, the system drops the object at block 131 and resets 

since drag and moved are now both true, the system 10 drag2 and drag equal to false at block 133. 
displays the pointer with the dragged object attached at In the "click-click" direct manipulation of the present 

block 99 and returns to block 71 of FIG. 8 to continue invention, the user presses and releases (clicks) mouse 

monitoring user input button number two while the pointer points to the 

Referring again to FIG. 14, if, at decision block 127, source object, which attaches the pointer to the source 

the button number two input is button up, the system 15 object, and then moves the mouse, which drags the 

tests at decision block 129 whether or not moved is true. source object with the pointer, to a target location, and 

If the input is button two up and moved is true, then the then presses and releases (clicks) the mouse button num- 

system drops the object at block 131, drag2 and drag are ber two, which drops the source at the target In the 

reset to equal false at block 133, and the system executes flowcharts, at decision block 119 of FIG. 14, when 

the redisplay pointer routine at block 93. Referring 20 button two is pushed down, the system tests, at decision 

briefly to FIG. 12, since drag and drag2 are reset to block 121, whether or not drag2 is true. Since, initially, 

equal false, the system displays the normal pointer at it is not, the system tests at decision block 123 whether 

block 97. Referring again to decision block 129 of FIG. or not the pointer is over an object. Since it is, drag is set 

14, if moved is not true, then the system tests at decision to true and moved is set to false at block 125 and the 

block 135 whether or not drag2 is true. Again, initially 25 system tests at decision block 95 of FIG. 12 whether or 

drag2 is false. Therefore, the system tests at decision not drag and moved or drag2 are true. Since, at this 

block 137 whether or not drag is true. If drag is true, point, they are not, the normal pointer is displayed at 

then drag2 is set equal to true at block 139 and the block 97. Since the user is "clicking" mouse button 

system again executes the redisplay pointer routine of number two, the next user input that is received is but- 

block 93. Referring again to FIG. 12, if, at decision 30 ton two up at decision block 127 of FIG. 14. The system 

block 95, drag2 is true, then the system displays the tests at decision block 129 whether moved is true, 

pointer with the dragged object attached at block 99. which it is not Thus, the system tests at decision block 

Referring back to FIG. 14, if, at decision block 135, 135 whether drag2 is true, and again, it is not There- 

drag2 is true, which indicates that it had been previ- fore, the system tests at decision block 137 whether or 

ously set to true by clicking mouse button number two 35 not drag is true. It will be recalled that drag was set to 

on an object, drag2 and drag are set to false at block 133 true when mouse button number two was pressed, 

and the system again executes the redisplay pointer Therefore, drag2 is set to true at block 139 and the 

routine at block 93. Referring again to FIG. 12, since system executes the re-display pointer sub-routine of 

drag2 and drag are both false, the system displays the FIG. 12. Since drag2 has been set to true, decision block 

normal pointer. 40 95 yields a "yes" so the system displays the pointer with 

The direct manipulation actions of the present inven- the dragged object attached at block 99. Then, the sys- 

tion can best be understood by taking specific examples tem responds to mouse movement input by continuing 

through the logic of FIGS. 10-12 and 14, recalling that to display the pointer with the dragged object attached 

at block 65 of FIG. 9 drag2 and drag are initially set to at block 99. When the user reaches the target location 

false. As a first example, assume that the user is perform- 45 the user clicks mouse button number two, which the 

ing a "normal" drag, which comprises the physical system perceives initially as a button two down user 

steps of pressing mouse button two while the pointer is input at decision block 119 of FIG. 14. The system tests 

on a source object moving the mouse while continuing at decision block 121 whether or not drag2 is true and, 

to press button two, which, drags the source object since it is, the system executes the re-display pointer 

across the display screen, and releasing mouse button 50 routine of FIG. 12 and continues to display the pointer 

number two, which drops the source object at a target with the dragged object attached to it at block 99. 
location. Referring to FIG. 14, if the system receives a The second half of a click is a mouse button two up. 

button two down input at decision block 119, the system Accordingly, the system tests at decision block 129 

tests at decision block 121 whether or not drag2 is true. whether or not moved is true, and since it is, the object 

Since it is not, the system tests at decision block 123 55 is dropped at block 131 and drag2 and drag are set to 

whether or not the pointer is over an object. Since this false at block 133. It should be noted that there may be 

example is a "normal" drag, the pointer is over an ob- an instance where the user clicks mouse button two, 

ject, therefore, at block 125, drag is set to true, moved thereby attaching the pointer to the dragged object, and 

is set to false, and the system executes the redisplay then decides to drop the object in the same place rather 

pointer sub-routine of FIG. 1Z Since we have just set 60 than drag it. That situation is handled by a "no" answer 

drag equal to true but moved equal to false, the test of at decision block 129. The system then tests at decision 

decision block 95 fails and the system continues to dis- block 135 whether or not drag2 is true. Since the user 

play the normal pointer at decision block 97. After the had previously clicked on the object, drag2 is true, 

user has pressed mouse button number two in the nor- Therefore, drag2 and drag are set to false at block 133 

raal drag the user next moves the mouse. Accordingly, 65 and the system, at block 97 of FIG. 12, displays the 

at decision block 79 of FIG. 10 the system processes the normal pointer. 

mouse movement as shown in FIG. 11 by setting moved From the foregoing, it may be seen that the present 

equal to true at block 91 and, referring to decision block invention provides new functionality that is easy to 
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learn and use with familiar graphical techniques. The 
user's ability to perform operations by direct manipula- 
tion is greatly expanded with the present invention. 
While the invention has been particularly shown and 
described with reference to a preferred embodiment, it 
will be understood by those skilled in the art that van- 
ous changes in form and detail may be made therein 
without departing from the spirit and scope of the in- 
vention. 
What is claimed is: 

X. A method of manipulating an icon in a data pro- 
cessing system having a plurality of other software 
objects displayed on a display screen which may be 
selected and manipulated utilizing a visual pointer, said 
plurality of other software objects including a partially 
obscured window which comprises the steps of: 
attaching a visual pointer to said icon; . 
moving said visual pointer with said icon attached 

thereto about said display screen; and 
selecting and manipulating one of said other software 20 
objects with said visual pointer while said icon 
remains attached thereto, said selecting and manip- 
ulating step including surfacing said partially ob- 
scured window. 

2. The method as claimed in claim 1, wherein: 25 
said plurality of other software objects includes a 

window; and 

said selecting and manipulating step includes scroll- 
ing data in said window. 

3. The method as claimed in claim 1, including the 30 
step of: 

detaching said visual pointer from said icon. 

4. The method as claimed in claim 1, including the 
steps of: 

positioning said visual pointer with said icon attached 35 

thereto over a target icon; 
detaching said visual pointer from said icon while 

said icon is over said target icon; and, 
performing an action on the object represented by 

said icon in response to detaching said icon from 40 

said visual pointer over said target icon. 

5. In a data processing system including a display 
screen and a mouse device for moving a visual pointer 
about said display screen, said mouse device including 


at least two buttons, a method of manipulating an icon 45 including: 


mouse button while said pointer is attached to said 
icon. 

7. In a data processing system including a display 
screen and a mouse device for moving a visual pointer 
about said display screen, said mouse device including 
at least two buttons, a method of manipulating an icon 
displayed on said display screen, which comprises the 
steps of: 

pointing to said icon with said visual pointer; 

pressing and releasing one of said mouse buttons 
while said visual pointer is pointing to said icon; 

attaching said visual pointer to said icon in response 
to pressing and releasing said one mouse button; 

moving said visual pointer with said icon attached 
thereto about said display screen with said one 
mouse button released; and, 

performing another mouse operation while said vi- 
sual pointer is attached to said icon, said mouse 
operation comprising: 

pointing to a scroll bar in a window with said visual 
pointer; and, 

clicking the other of said mouse buttons, thereby to 
scroll data in said window. 

8. The method as claimed in claim 7, including the 
steps of: 

pressing and releasing said one mouse button while 
said visual pointer is attached to said icon; and 

automatically detaching said visual pointer from said 
icon in response to pressing and releasing said one 
mouse button while said pointer is attached to said 
icon. 

9. In a data processing system including display 
screen and a mouse device for moving a visual pointer 
about said display screen, said mouse device including 
at least two buttons, the improvement which comprises: 

means for attaching said visual pointer to an icon in 
response to pressing and releasing one of said 
mouse buttons; and 

means for performing another mouse operation while 
said visual pointer is attached to said icon, said 
means for performing another mouse operation 
while said pointer is attached to said icon compris- 
ing means for surfacing a partially obscured win- 
dow in response to clicking the other of said mouse 
buttons. 

10. The data processing system as claimed in claim 9, 


50 


55 


displayed on said display screen, which comprises the 
steps of: 

pointing to said icon with said visual pointer; 

pressing and releasing one of said mouse buttons 
while said visual pointer is pointing to said icon; 

attaching said visual pointer to said icon in response 
to pressing and releasing said one mouse button; 

moving said visual pointer with said icon attached 
thereto about said display screen with said one 
mouse button released; and, 

performing another mouse operation while said vi- 
sual pointer is attached to said icon, said mouse 
operation comprising: 

pointing to a partially obscured window with said 
visual pointer; and, clicking the other of said mouse 60 
buttons, thereby to surface said partially obscured 
window. 

6. The method as claimed in claim 5, including the 
steps of: 

pressing and releasing said one mouse button while 65 
said visual pointer is attached to said icon; and, 

automatically detaching said visual pointer from said 
icon in response to pressing and releasing said one 


means for automatically detaching said visual pointer 
from said icon in response to pressing and releasing 
said one mouse button while said visual pointer is 
attached to said icon. 

11. In a data processing system including display 
screen and a mouse device for moving a visual pointer 
about said display screen, said mouse device including 
at least two buttons, the improvement which comprises: 

means for attaching said visual pointer to ah icon in 
response to pressing and releasing one of said 
mouse buttons; and 

means for performing another mouse operation while 
said visual pointer is attached to said icon, said 
means for performing another mouse operation 
while said pointer is attached to said icon compris- 
ing means for scrolling data in a window in re- 
sponse to clicking the other of said mouse buttons. 

12. The data processing system according to claim 11, 
including: 

means for automatically detaching said visual pointer 
from said icon in response to pressing and releasing 
said one mouse button while said visual pointer is 
attached to said icon. 

***** 
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